Papers with GRPO style reinforcement learning
MMR-GRPO: Accelerating GRPO-Style Training through Diversity-Aware Reward Reweighting (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have demonstrated remarkable capabilities in mathematical reasoning tasks. |
| Approach: | They propose to use Maximal Marginal Relevance to reweigh rewards of multiple rollouts by balancing rollout quality with diversity to reduce rollout redundancy. |
| Outcome: | The proposed approach reduces training time and costs by 47.9% . evaluations across three model sizes, three GRPO variants, and five mathematical reasoning benchmarks show that it achieves comparable peak performance while requiring on average 70.2% less wall-clock time. |